ft . 

[ * 



® 



J 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



© Publication number: 



0 667 718 A2 



EUROPEAN PATENT APPLICATION 



v^jy r\|jfjt ischium iiuiiiucfi. so i u i i • > 


int n e. H04N Q/04 

V^Jy INI. OI. . ■ 1 w^rl^l 9/w*t 


© Date of fiting: 10.02.95 




© Priority: 15.02.94 US 196603 


© Inventor: Smith, Craig Michael, c/o Eastman 


@ Date of publication of application: 


Kodak Company 


Pat. Legel Staff, 


16.08.95 Bulletin 95/33 


343 State Street 




Rochester, 


© Designated Contracting States: 


New York 14650-2201 (US) 


DE FR GB 




© Applicant: EASTMAN KODAK COMPANY 


© Representative: Schmidt, Peter, Dipl.-lng. et al 


343 State Street 


KODAK Aktiengeselischaft 


Rochester, 


Patentabteilung 


New York 14650 (US) 


D-70323 Stuttgart (DE) 



© Electronic still camera with user-selectable image resolution. 



© An electronic camera is adapted for processing 
images of different resolution to provide a user 
selectable image record size. A buffer memory is 
provided for storing color image pixels from a sensor 
corresponding to at least one image. Processing 
responsive to a resolution mode switch controls the 
order in which color image pixels are selected for 
output storage in both vertical and horizontal direc- 



tions. The order selected by the resolution switch 
includes a full resolution mode, and at least one 
reduced resolution mode in which the low resolution 
color image pixels are calculated to exactly replicate 
the pixel geometry of the original CFA image. This 
simplifies the image processing for the rest of the 
imaging chain because the same algorithms can be 
used regardless of the selected image resolution. 
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Field of Invention 

This invention relates to the field of electronic 
imaging, and, in particular, to an electronic still 
camera providing image capture at a plurality of 
resolution levels. 

BACKGROUND OF THE INVENTION 

In the practice of electronic color imaging, it is 
desirable to simultaneously capture image data in 
sets of three color planes, usually red, green, and 
blue. When the three color planes are combined, it 
is possible to create a high-quality color image. 
Capturing these three sets of image data can be 
done in a number of ways. Ideally, three separate 
two-dimensional image sensors would be used, 
each capturing one color plane. However, in the 
interest of conserving space and cost, as well as 
minimizing complexity, image data in three colors 
is ordinarily captured with a single two-dimensional 
sensor; such a sensor includes an array of pho- 
tosensitive pixels that are covered by a pattern of 
red, green, and blue filters. This type of filter pat- 
tern is known as a color filter array (CFA), and the 
resulting image is referred to hereafter as a CFA 
image. Figure 1 shows how the red (R), green (G), 
and blue (B) pixels are commonly arranged in a 
CFA pattern on the surface of an image sensor. 
The illustrated pattern is the well known Bayer 
array, which is described in U.S Patent No. 
3,971 ,065, incorporated herein by reference. In par- 
ticular, note that each photosensitive pixel pro- 
duces a single color signal. 

When a CFA image is obtained from a sensor 
using a CFA pattern, it is therefore necessary to 
interpolate the missing red, green, and blue values 
so that there is an estimate of all three color values 
for each pixel location. Once the interpolation is 
completed, each pixel is associated with three col- 
or values and therefore can be processed by a 
variety of known image processing techniques, de- 
pending on the needs of the system. Some exam- 
ples of such processing include image sharpening, 
color correction, or halftoning. 

An electronic camera of this type is described 
in patent application Serial Number 085,516, en- 
titled "Single Sensor Color Camera with User- 
Selectable Image Record Size", filed June 30, 
1993 in the name of the same assignee as the 
present application. Furthermore, application S.N. 
085,516 describes an electronic camera adapted 
for processing images of different resolution in 
order to provide a user selectable image record 
size. A buffer memory is provided for storing color 
image pixels from a sensor, and a timing controller 
responsive to a resolution mode switch controls the 
order in which color image pixels are selected for 



storage in both vertical and horizontal directions. 
The order selected by the resolution mode switch 
includes a full resolution mode, and at least one 
reduced resolution mode in which the color image 

5 pixels are subsampled. Figure 2A shows an exam- 
ple of one such low-resolution pattern, with a circle 
surrounding each sampled pixel. 

The electronic camera described in Serial 
Number 085,516 is capable of storing full resolution 

io CFA images or reduced resolution images, or a 
combination of images of the different resolutions. 
Though several methods of generating the low res- 
olution image are described, all of the methods 
have the same disadvantage. They all create a low 

75 resolution CFA image that is spatially different from 
the original CFA image. Even in Figure 2B, which 
shows another low resolution CFA image, the red 
pixels and the blue pixels are not centered with 
respect to the green pixels. Consequently, interpo- 

20 lated low resolution pixels are calculated using 
pixels that are not centered in the same geometric 
pattern as the original CFA image. This happens 
because it is difficult to find a subsampling pattern 
for the Bayer array that would replicate the geo- 

25 metric spacing of the original CFA pattern, at least 
for moderate levels of resolution reduction. The 
shifted geometry of the reduced resolution pixels 
has the following disadvantages. 

1 . The CFA interpolation is designed for the full 
30 resolution CFA geometry. If the interpolation is 

applied to the shifted geometry of the low reso- 
lution pixels, e.g. as shown in either Figure 2A 
or Figure 2B, it will cause artifacts in the image. 
To avoid this, it is necessary to implement a 
35 separate, and typically more complicated, inter- 
polation algorithm. 

2. If the image is stored in a compressed form, 
the compression algorithm may not be optimal 
for the low resolution pixel geometries. This can 

40 cause the compression algorithm to compress at 
a higher bit rate or lower quality. For example, 
unwanted color shadows and color fringing can 
show up in the subsequently decompressed im- 
age. 

45 3. If further resolution reduction is necessary, 
each new reduction shifts the geometry again, 
so that new interpolation algorithms must be 
designed. 

50 SUMMARY OF THE INVENTION 

The present invention is directed to overcom- 
ing one or more of the problems set forth above. 
Briefly summarized, according to one aspect of the 
55 present invention, an electronic camera adapted for 
capturing and processing images of different reso- 
lution includes an image sensor, means for gen- 
erating an image signal, means for selecting one of 
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a plurality of resolution levels, and a processor for 
producing a reduced resolution image. The image 
sensor includes a two-dimensional array of 
photosites covered by a pattern of chrominance 
and luminance color filters, and generates an im- 
age signal corresponding to a two-dimensional im- 
age captured by the sensor. The plurality of resolu- 
tion levels provide a full resolution image arranged 
according to the pattern of color filters, and at least 
one reduced resolution image. The processor pro- 
duces the reduced resolution image by averaging 
areas of the captured image to produce a reduced 
resolution image arranged according to a pattern 
that replicates the pattern of color filters seen in the 
full resolution image. 

The advantageous effect of the invention is that 
image processing algorithms designed for full reso- 
lution CFA images can also be used on reduced 
resolution CFA images. More specifically, compres- 
sion and interpolation algorithms that necessarily 
make assumptions about CFA geometries in their 
methodologies do not have to be redesigned to 
handle low resolution images. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The prior art and the invention will be de- 
scribed in relation to the drawings, in which 

Figure 1 is a diagram of the Bayer color filter 
array pattern as known in the prior art; 
Figures 2A and 2B are diagrams of known sub- 
sampling patterns that can be applied to the 
Bayer array shown in Figure 1; 
Figure 3 is a block diagram of a single sensor 
color camera with CFA compatible resolution 
reduction in accordance with the invention; 
Figure 4 is a flowchart showing the operation of 
the camera shown in Figure 3; 
Figure 5 is a view of a portion of the sensor 
shown in Figure 3; 

Figure 6 shows diagrams of the pixel locations 

(filter patterns) used in the disclosed algorithms 

to generate low resolution pixels; 

Figure 7 is a diagram showing how the filter 

patterns of Figure 6 are applied to the original, 

high resolution image; and 

Figure 8 is a diagram showing the geometrical 

regularity of the low resolution CFA geometry 

resulting from the processing shown in Figure 7. 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

Since electronic still cameras employing a sin- 
gle color sensing device are well known, the 
present description will be directed in particular to 
elements forming part of, or cooperating more di- 
rectly with, apparatus in accordance with the 
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present invention. Elements not specifically shown 
or described herein may be selected from those 
known in the art. 

Referring to Figure 3, the elements of a single 

5 sensor electronic camera are shown in block form. 
The camera is divided generally into an input sec- 
tion 10 for receiving image light and capturing an 
image, a processing and storage section 12 for 
processing and storing captured images, a control 

10 and display section 14 for user interface with the 
camera, and a detachable docking unit 16 for trans- 
ferring stored images from the processing and stor- 
age section 12 to a host computer 18. The camera 
shown in Figure 3 is sometimes referred to as a 

75 dockable electronic still camera, since it relates to 
the computer 16 generally through the docking unit 
16 (although, as will be described, a serial port is 
provided on the camera body itself for direct con- 
nection with the computer 18). 

20 The operation of the camera is generally 

shown in Figure 4. With this type of imaging sys- 
tem, the camera is generally removed from the 
docking unit 16 and used at a location significantly 
remote from the computer 18. The camera is pe- 

25 riodically returned to the computer, and images are 
then downloaded through the docking unit 16 (or 
the serial port) to free up the camera memory for 
more photographs. Because it is often inconvenient 
for the user to return to the computer to download 

30 images, the camera provides the user with the 
option to store some, or all, of the images at less 
than the highest resolution level, so that more 
images may be stored in the camera memory 
before having to return to the computer 18 to 

35 download the images. The purpose of the invention 
is to filter and subsample a CFA image for a lower 
resolution in a way that maintains the original CFA 
geometry. After an image is captured and stored in 
the camera's frame store (section 19a), the desired 

40 resolution level is checked in section 19b. If a 
lower resolution is selected, the camera filters and 
subsamples the pixel data according to the tech- 
nique of the invention (later described), and stores 
the resultant low resolution image in its nonvolatile 

45 memory in section 19c. Such storage may include 
compression. One advantage of the invention is 
obtained at this point, namely, that the compres- 
sion algorithm designed for the full resolution im- 
age can also be used in the section 19c on the 

so reduced resolution image. After all images are cap- 
tured in section 19d, the camera is connected to 
the docking adapter and the interface is initiated 
through the computer 18 (by appropriate software, 
which is not part of this invention). Another advan- 

55 tage of the invention is obtained at this point, 
where the same decompression and interpolation 
algorithms designed for the full resolution image 
can also be used in the section 1 9e on the reduced 

3 
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resolution image. The desired images are selected, 
and perhaps previewed, through the computer 18, 
and accordingly downloaded to its resident mem- 
ory. 

Referring to Figure 3, the input section 10 
includes a lens 20 for imaging light from an object 
22 through a shutter and aperture control 24 and 
an optical low pass filter 26 upon a charge-coupled 
device (CCD) image sensor 28. The sensor 28 is 
shown in further detail in Figure 5 to include a color 
filter array 30 overlying an array of photosites 32 
(shown for illustration through a cut-away portion 
34 of the color filter array 30). The color filter array 
30 has a plurality of red, green, and blue elements 
36a, 36b, and 36c arranged in a predetermined 
geometrical arrangement, in this case the familiar 
"Bayer array" described in U.S. Patent No. 
3,971 ,065, which is incorporated herein by refer- 
ence. A characteristic of one form of the "Bayer 
array" is that the luminance picture elements (pix- 
els), i.e., corresponding to the green element 36b, 
are arranged horizontally and vertically in a check- 
erboard pattern, and the chrominance pixels, i.e., 
corresponding to the red and blue color elements 
36a and 36c, are each vertically and horizontally 
adjacent to a luminance pixel. A driver 38 (shown 
in Figure 3) generates clocking signals for control- 
ling the image integration time and the vertical 
transfer of image pixels to a high speed horizontal 
register 40 (shown in Figure 5). An output capaci- 
tive node 42 produces a signal which is amplified, 
processed, and stored in the processing and stor- 
age section 12. 

The input section 10 further includes a lens 
cap 44 connected to a main switch 46 that ac- 
tivates the camera when the cap 44 is moved to 
expose the lens 20 to image light, and a close-up 
lens 48 that can be optionally moved into the path 
of image light for close-up exposures. The input 
section also includes an optical viewfinder 50 for 
framing the object 22 in relation to the sensor 28, a 
flash unit 52 for illuminating the object 22, and a 
photocell 54 for converting image intensity informa- 
tion into an electrical signal that is used in the 
processing and storage section 12 to regulate the 
shutter and aperture control 24. 

The processing and storage section 12 in- 
cludes a correlated double sampling circuit 56 for 
providing analog image samples to an analog-to- 
digital (A/D) converter 58. The digitized signals are 
corrected for white balance, gamma, and other 
conventional distortions by a correction read-only 
memory (ROM) 60, which provides output signals 
that are applied to a frame buffer memory 62, 
which is a dynamic random-access memory 
(RAM). The buffered image signals are processed, 
e.g., compressed, in a digital signal processor 
(DSP) 64 and then stored in an output memory, 
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such as flash electrically programmable read-only 
memory (EPROM) 66. When the camera is to send 
image data to the computer 18, one of two data 
paths are used. A serial path from the flash EP- 
5 ROM memory 66 to a serial port 68 is provided 
through a universal synchronous/asynchronous re- 
ceiver/transmitter (UART) 70 and an RS232 driver 
72. Alternatively, a faster parallel path is provided 
through connectors 74a and 74b via a small com- 

10 puter systems interface (SCSI) controller 76 in the 
docking unit 16 to a parallel port 78. 

A timing generator 80 provides timing signals 
to the aforementioned elements in the processing 
and storage section 12, in particular providing tim- 

75 ing input to a microprocessor controller 82 and 
address timing to the frame buffer memory 62, the 
DSP 64, the flash EPROM memory 66, and a 
latching and decoding circuit 84. The microproces- 
sor controller 82 in turn controls the A/D converter 

20 58, the correction ROM 60, the flash unit 52, and a 
stepping motor driver 86, which controls operation 
of the shutter and aperture control 24. The micro- 
processor controller 82 also controls a display ele- 
ment 50a in the viewfinder 50 (for indicating flash 

25 ready, under/over exposure, and the like), and re- 
ceives exposure data from the photocell 54. 

While the processing and storage section 12 
automatically controls image exposure upon the 
CCD sensor 28 by means of data input from the 

30 photocell 54, a plurality of switches are provided in 
the control and display section 14 for manually 
activating a variety of additional features. (Some 
switches directly activate the respective features, 
while other switches activate a menu of choices on 

35 a liquid crystal display (LCD) 90.) For instance, a 
switch 88a moves the close-up lens 48 into posi- 
tion, a switch 88b allows the user to select which of 
two (high or low) different resolution levels of sen- 
sor data are stored in the flash memory 66, a 

40 switch 88c activates a low resolution "burst" mode 
in which several pictures are rapidly taken, a switch 
88d activates the flash unit 52, and a switch 88e 
activates a self-timer delay mode. A capture switch 
88f initiates each exposure. The liquid crystal dis- 

45 play (LCD) 90 indicates the selected feature values. 
Depending upon the capabilities of the camera, 
further input may be provided, e.g., levels of com- 
pression (number of bits) may be selected, and the 
color mode (black/white or color) may be des- 

50 ignated. 

A battery 92 provides power to the camera 
through a power switcher 94 and a DC/DC con- 
verter 96 when the camera is disconnected from 
the docking unit 16. When the docking unit 16 is 

55 connected between the computer 18 and the cam- 
era, the computer supplies power to an AC/DC 
converter 98 in the docking unit 16, which in turns 
powers a battery charger 100 that connects to the 

4 
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camera and charges the battery 92. 

In using the camera according to the invention, 
activation of the capture switch 88f allows the cam- 
era to capture an image, which is then stored in the 
flash EPROM memory 66, together with other im- 
ages, until they can be downloaded to the com- 
puter 18. The image which is read out from the 
sensor 28 has, in one embodiment, a total of 512 
lines and 768 pixels per line. Since the sensor 28 
incorporates a "Bayer" color filter pattern, the 
digitized values from the A/D converter 58 cor- 
respond to values from the various color elements 
36a, 36b, 36c on the sensor 28. As an example, 
eight bit digital pixel values are read from the CCD 
sensor 28 via ROM 60 at relatively high readout 
rate and stored in the dynamic RAM frame buffer 
memory 62. The image signals are then read from 
the frame buffer memory 62 at a relatively slower 
speed, compressed using a differential pulse code 
modulation (DPCM) algorithm (which compresses 
the image from 8 bits per pixel to 3 bits per pixel) 
implemented in the DSP 64 pursuant to instructions 
stored in a program ROM 64a, and stored in the 
flash EPROM memory 66, which can hold several 
compressed images. This process typically takes 
about 4 seconds, which means that full resolution 
images can only be stored in the flash EPROM 
memory 66 every 4 seconds. The use of the buffer 
memory 62 allows the DSP 64 to operate at a 
throughput rate different from the CCD sensor 28. 
The aforementioned latching and decoding circuit 
84 accomplishes this separation of throughput rates 
by coordinating the requirement of the DSP 64 with 
control of the frame buffer memory 62 and the 
flash EPROM memory 66. 

The camera includes the switch 88b which 
allows the user to select the image record size, that 
is, which of (at least) two different resolution levels 
of sensor data are stored in the flash memory 66. 
When the switch 88b activates the "low resolution" 
mode, the controller 82 directs the digital signal 
processor 64 to initiate processing and output of, 
e.g., a quarter size image. This quarter size image 
is then compressed by the DSP 64, and stored in 
the flash EPROM memory 66. It is thus possible to 
store four times as many low resolution images as 
high resolution images in the flash memory 66. In 
order to form the quarter size images, a suitable 
"subsampling" pattern is required. For example, if 
only every second pixel of every second line was 
selected for storage in the buffer memory, the 
image would contain only : values of one of the 
three colors. To provide a color image, the color 
filter array pixels must be subsampled properly. 
This subsampling should be done in a manner that 
maintains good luminance resolution, without in- 
troducing false color "aliasing" artifacts. 
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The improvement obtained by the invention is 
based on subsampling according to a filtering pat- 
tern that generates a low resolution image that 
replicates the pixel geometry of the original CFA 

5 image— in this embodiment, a low resolution image 
with the same checkerboard geometry as the origi- 
nal Bayer CFA image. This simplifies the image 
processing for the rest of the image chain because 
the same algorithms can be used regardless of the 

10 selected image resolution. By using the filtering 
and subsampling patterns described in this inven- 
tion, it is possible to use one set of image process- 
ing routines to process the image in the host 
computer. This makes implementation and main- 

75 tenance of the image processing function much 
simpler. 

There are several methods of implementing a 
resolution reduction algorithm that will proportion- 
ately replicate spatial arrangement of the original 

20 CFA geometry. The currently preferred embodi- 
ment of this invention generates low resolution pix- 
els as a linear combination of pixels in an area 
around the desired low resolution pixel location. 
Figure 6 shows the patterns of the surrounding 

25 pixels that are used to calculate a low resolution 
pixel centered in each pattern for each of the 
colors, as well as the equations for calculating the 
low resolution pixel values. To generate a low reso- 
lution image with CFA compatible geometry, the 

30 filtering patterns shown in Figure 6 are applied to 
the original CFA image as shown in Figure 7. The 
resulting low resolution image, after processing is 
completed in accordance with Figures 6 and 7, is 
shown in Figure 8 as a lower resolution replication 

35 of the original Bayer CFA pattern. Note, in particu- 
lar, that the original geometric spacing has been 
preserved. 

The equations shown in Figure 6 that are used 
to filter the image in the preferred embodiment are 

40 designed so that all of the coefficients are powers 
of two. This allows for easy implementation in 
many digital systems. Other sets of coefficients 
could easily be used in these equations. To further 
reduce implementation complexity, some of the 

45 coefficients, especially in the red and blue chan- 
nels, could be set to zero. If more complexity is 
possible, the coefficients could be set to any real 
numbers. As long as the resulting low resolution 
image has the same geometry as the original CFA 

so image, it is within the scope of this invention. 

In order to perform the processing indicated by 
the algorithms illustrated in Figure 6, the full resolu- 
tion image is stored in the frame buffer memory 62 
in the low resolution mode, and the DSP 64 pro- 

55 cesses the values from multiple pixels of the same 
color to form the CFA compatible color subsam- 
pled image, by averaging some of the pixels as set 
out by the algorithms of Figure 6. The pixels cov- 

5 
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ered by the filter patterns illustrated by Figure 6 
are obtained by suitably programming the micro- 
processor controller 82 to instruct the digital signal 
processor 64 to select the appropriate pixel values, 
and the digital signal processor 64 is itself pro- 5 
grammed to perform the respective filter calcula- 
tions. All such programming is straight-forward and 
conventional. 

The invention has been described in detail with 
particular reference to a preferred embodiment 10 
thereof, but it will be understood that variations and 
modifications can be effected within the spirit and 
scope of the invention. For example, while two 
resolution modes are disclosed in connection with 
the camera of Figure 3, the same principles apply 75 
regardless of the number of modes. For instance, a 
third mode could further subsample the pattern of 
sampled elements to provide a yet lower resolution 
image. Moreover, other reduced resolution filter 
patterns may be used, providing that the patterns 20 
replicate the original CFA filter geometry. Other 
CFA patterns may also be used, e.g., based on 
complementary colors (cyan, magenta, and yel- 
low). 

25 

PARTS LIST 

10 INPUT SECTION 

12 PROCESSING AND STORAGE SEC- 
TION 30 
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TION 35 

19b RESOLUTION CHECK SECTION 
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19d COMPUTER INTERFACE SECTION 

19e DECOMPRESSION AND INTERPOLA- 
TION SECTION 40 

20 LENS 
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36C BLUE COLOR ELEMENT 
38 DRIVER 

40 HORIZONTAL REGISTER 

42 OUTPUT CAPACITATIVE NODE 55 
44 . LENS CAP 
46 MAIN SWITCH 

48 CLOSE-UP LENS 



50 OPTICAL VIEWFINDER 

52 FLASH UNIT 

54 PHOTOCELL 

56 CORRELATED DOUBLE SAMPLING 

CIRCUIT 

58 A/D CONVERTER 

60 CORRECTION ROM 

62 FRAME BUFFER MEMORY 

64 DSP 

64A PROGRAM ROM 

66 FLASH EPROM MEMORY 

68 SERIAL PORT 

70 UART 

72 RS232 DRIVER 

74A CONNECTOR 

74B CONNECTOR 

76 SCSI CONTROLLER 

78 PARALLEL PORT 

80 TIMING GENERATOR 

82 MICROPROCESSOR CONTROLLER 

84 LATCHING AND DECODING CIRCUIT 

86 STEPPING MOTOR DRIVER 

88A CLOSE-UP SWITCH 

88B RESOLUTION SWITCH 

88C BURST MODE SWITCH 

88D FLASH SWITCH 

88E SELF-TIMER SWITCH 

88F CAPTURE SWITCH 

90 LCD 

92 BATTERY 

94 POWER SWITCHER 

96 DC/DC CONVERTER 

98 AC/DC CONVERTER 

1 00 BATTERY CHARGER 

Claims 

1. An electronic camera adapted for capturing 
and processing images of different resolution, 
said camera comprising: 

an image sensor having a two-dimensional 
array of photosites covered by a pattern of 
luminance and chrominance color filters; 

means for generating an image signal cor- 
responding to a two-dimensional image cap- 
tured by said image sensor; 

means for selecting one of a plurality of 
resolution levels for the image signal, said res- 
olution levels providing a full resolution image 
arranged according to said pattern of color 
filters and at least one reduced resolution im- 
age; and 

a processor responsive to a selected re- 
duced resolution level for operating on the 
image signal by averaging areas of said cap- 
tured image to produce a reduced resolution 
image arranged according to a pattern that 
replicates the pattern of color filters seen in the 
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full resolution image. 

2. A camera as claimed in claim 1 wherein said 
image sensor is covered by a pattern of lu- 
minance and chrominance color filters having a 5 
predetermined geometrical arrangement, and 
wherein said processor produces a reduced 
resolution image arranged according to a pat- 
tern that proportionately replicates the prede- 
termined geometrical arrangement of color fil- 10 
ters seen in the full resolution image. 

3. A camera as claimed in claim 2 wherein the 
pattern of the reduced resolution image cor- 
responds to pixel locations in the full resolution 15 
image that are separated in each dimension by 

at least one color filter location. 

4. An electronic camera adapted for capturing 

and processing images of different resolution, 20 
said camera comprising: 

an image sensor having a two-dimensional 
array of pixels covered by a pattern of lu- 
minance and chrominance color filters having a 
predetermined geometrical spatial arrange- 25 
ment; 

means for generating an image signal 
comprised of pixels corresponding to a two- 
dimensional image captured by said image 
sensor; 30 

means for selecting one of a plurality of 
resolution levels for the image signal, said res- 
olution levels providing a full resolution image 
and at least one reduced resolution image; and 

a processor responsive to a selected re- 35 
duced resolution level for operating on the 
pixels comprising the image signal by produc- 
ing a reduced resolution image arranged ac- 
cording to a pattern that replicates the pre- 
determined spatial arrangement of the color 40 
filters seen in the full resolution image. 

5. A camera as claimed in claim 4 wherein the 
reduced resolution image comprises a reduced 
resolution array of processed pixels output by 45 
said processor. 

6. A camera as claimed in claim 5 wherein said 
processor operates upon pixels comprising the 
image signal by averaging pixels surrounding 50 
said processed pixel location to produce a 
reduced resolution image that replicates the 
predetermined spatial arrangement of the color 
filters seen in the full resolution image. 

55 

7. An electronic camera adapted for processing 
images of different resolution, said camera 
comprising: 
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an image sensor for generating an image 
signal representative of color image pixels ar- 
ranged in vertical and horizontal directions as 
obtained from a two-dimensional array of 
photosites covered by a color filter array of 
luminance and chrominance color filters; 

a buffer memory having sufficient capacity 
for storing the color image pixels correspond- 
ing to at least one image; 

an output memory, connected subsequent 
to the buffer memory, for storing processed 
image signals obtained from the buffer mem- 
ory; 

a resolution mode switch for selecting the 
pixel resolution of the image by specifying the 
order in which the color image pixels are se- 
lected for storage in both vertical and horizon- 
tal directions, said order including a full resolu- 
tion mode in which all color image pixels are 
selected and at least one reduced resolution 
mode in which a fewer number of color image 
pixels are selected; 

a controller responsive to the pixel resolu- 
tion selected by the resolution mode switch for 
accordingly changing the number of horizontal 
and vertical pixels that represent the image, 
said controller effecting an averaging of the 
color image pixels for the reduced resolution 
mode to produce a reduced resolution image 
arranged according to a pattern that replicates 
the color filter array of color -filters seen in the 
full resolution image; and 

means for storing the selected color image 
pixels in said output memory, whereby said 
output memory is able to store more images in 
said reduced resolution mode than in said full 
resolution mode. 

8- A camera as claimed in claim 7 wherein said 
buffer memory is operable to store all of the 
color image pixels from said image sensor and 
wherein said controller effectuates the averag- 
ing for the selected pixel resolution by accord- 
ingly selecting appropriate pixels from said 
buffer memory for processing and storage in 
said output memory. 

9. A camera as claimed in claim 8 wherein the 
color filter array is a Bayer array. 

10. A camera as claimed in claim 9 wherein the 
reduced resolution image is composed of pro- 
cessed color pixels, said controller effecting 
the averaging of same-colored pixels in the 
immediate neighborhood of the processed col- 
or pixel. 



13 EP 0 667 718 A2 14 

11. A camera as claimed in claim 7 further com- 
prising means for compressing the selected 
color image pixels, whereby said storing 
means stores compressed color image pixels 
in said output memory. 5 
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(§) Electronic still camera with user-selectable image resolution 
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© An electronic camera is adapted for processing 
images of different resolution to provide a user 
selectable image record size. A buffer memory is 
provided for storing color image pixels from a sensor 
corresponding to at least one image. Processing 
responsive to a resolution mode switch controls the 
order in which color image pixels are selected for 
output storage in both vertical and horizontal direc- 



tions. The order selected by the resolution switch 
includes a full resolution mode, and at least one 
reduced resolution mode in which the low resolution 
color image pixels are calculated to exactly replicate 
the pixel geometry of the original CFA image. This 
simplifies the image processing for the rest of the 
imaging chain because the same algorithms can be 
used regardless of the selected image resolution. 
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